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Abstract 

Uniform asymptotic confidence bands for a multivariate regression function in an in- 
verse regression model with a convolution-type operator are constructed. The results are 
derived using strong approximation methods and a limit theorem for the supremum of a 
stationary Gaussian field over an increasing system of sets. As a particular application 
asymptotic confidence bands for a time dependent regression function ft{x) {x G M'^, t G M) 
in a convolution-type inverse regression model are obtained. To the best knowledge of the 
authors the results presented in this paper are the first which provide uniform confidence 
bands for multivariate nonpar ametric function estimation in inverse problems. 
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1 Introduction 

1.1 Inverse regression models 

In many applications it is impossible to observe a certain quantity of interest because only indirect 
observations are available for statistical inference. Problems of this type are called inverse prob- 
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lems and arise in many fields such as medical imaging, physics and biology. Mathematically the 
connection between the quantity of interest and the observable one can often be expressed in terms 
of a linear operator equation. Well known exa mples are Positron Er nission Tomography, which i n- 
volves the Radon Tran sform, (ICavalierl (120001 ) ). the heat equation (IMair and RuymgaartI (Il996l )). 
the Laplace Transform Saitoh ( IQQtI ) and the reconstruction of astronomical and biological images 
from teles copic and mi cr oscopic imaging dey ices, which is closely connected to convolution-type 



operators (lAdorfl (Il995l ) 



Bertero et al. 



(120091 ) I 



Inverse problems have b een studied intens ively in a deterministic framework and in mathematical 
physics. See for example [ 
sis of inverse problems or 



Saitohl ( 



ngl et al.l (|l996f) for an overview of existing methods in numerical analy- 



19971 ) for techniques based on reproducing kernel Hilbert spaces. 



Recently, the investigation of inverse problems has also become of importance from a statistical 
point of view. Here, a particularly interesting and active field of research is the construction of 
statistical inference methods such as hypothesis tests or confidence regions. 
In this paper we are interested in the convolution type inverse regression model 



Y = if*i;)ix)+e, 



where e is a random error, the operation * denotes convolution, ip is a given square integrable 
function and the object of interest is the function / itself. An important and interesting appli- 
cation of the inverse regression model (11.11) is the recovery of images from imaging devices such 
as astronomical telescopes or fluorescence microscopes in biology. In these cases, the observed, 
uncorrected image is always at least slightly blurry due to the physical characteristics of the prop- 
agation of light at surfaces of mirrors and lenses in the telescope. In this application the variable 
X represents the pixel of a CCD and we can only observe a blurred version of the true image 
modeled by the function /. In the corresponding mathematical model the observed image is (at 
least approximately) a convolution of the real image with the so-called point-spread-function ip, 
i.e. an inverse problem with convolution operator. 

The inference problem regarding the function / is called inverse problem with stochastic noise. 
In recent years, the problem of estimating the regression function / has become an important 
field of research, w here the main focus i s on a one dimensional p r edicto r. Several authors propose 
Bayesian methods ( Bertero et al.l ( 2009 ): Kaipio and Somersalo ( 2010)) and co n struct est i mator s 
using tools fro r a nonp arametric curve estimation ( Mair and Ruymgaart ( 1996 ): Cavalierl ( 2008 ): 



Bissantz et al 



(l2007bl )). Further inference methods, in par ticular the c o nstru ction of confidence 
intervals and confidence bands, are much less developed. iBirke et~aL (2010) have constructed 
uniform confidence bands for the function / with a one-dimensional predictor. 
The present work is motivated by the fact that in many applications one has to deal with an 
at least two-dimensional predictor. A typical example is image reconstruction since a picture 
is a two-dimensional object. Also in addition to the spatial dimensions, the data often show a 
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dynamical behavior, thus repeated measurements at different times can be used to extend the 
statistical inference. For example in astrophysics spectra of different objects like supernovae or 
variable stars underly changes in time on observable timescales. In this case the function / depends 
on a further parameter, say ft and the reconstruction problem refers to a multivariate function 
even if the predictor is univariate. 

The purpose of the present paper is the investigation of asymptotic properties of estimators for 
the function / in model (11. ip with a multivariate predictor. In particular we present a result 
on the weak convergence of the sup-norm of an appropriately centered estimate, which can be 
used to const ruct asymptotic confide i ice ba nds for the regression function /. In contrast to other 
authors (e.g. ICavalier and Tsybakovl (120021 )) we do not assume that the function ip in model (II. ip 
is periodic, because in the reconstruction of astronomical or biological images from telescopes or 
microscopic imaging devices this assumption is often unrealistic. 



1.2 Confidence bands 



In a pioneering work. 



Bickel and Rosenblatt 



(1l973bl ) extended results of ISmirnovl ( 1l950l ) for a 
histogram estimate and constructed confidence bands for a density function of independent iden- 
tical distributed (i.i.d) observations. Their method is based on the asymptotic distribution of 
the supremum of a centered kernel density estimator. Since then, their method has been fur- 
ther developed b oth in the context of density and regres sion estimation. For d ensity estimation, 
Neumann ( 1998 ) derived bootstrap confidence bands, and Gine and Nickl ( 201ol ) derived adaptive 
asymptotic ba nds over generic sets. In a reg ression context, asymptotic confid ence bands were 



constructed by Eubank and SpeckmanI ( 1l993l ) for the Nadaraya- Watson and by IXial (119981 ) for a 
local pol ynoni i al esti r nator. Bootstrap confidence b ands fo r nonparametric regression were pro - 
posed by Hall ( 1993 ). Neumann and Polzehl ( 19981 ) and by Claeskens and van Keilegom ( 2003 ). 



For the statistical inverse problem of deconvolution density estimation, 



Bissantz et al. 



(l2007al ) 



constructed asymptotic and bootstrap confidence bands, where iLounici and Nickll (|2011l) obtained 
non-asymptotic confidence bands by using concentration inequalities. Recently, Birke et aD (j2010 ) 
provided uniform asymptotic and bootstrap confidence bands for a spectral cut-off estimator in 
the one- dimensional indirect regression model with convolution operator. 

All these results are limited to the estimation of univariate densities and regression functions, and 
are not applicable in cases, where the quantity of interest depends on a multivariate predictor. In 
such cases - to the best knowledge of the authors - confidence bands are not available. One reason 
for this gap is that a well-establ ished way to construc t asymp totic uniform confidence bands, 
which uses a pioneering result of 



Bickel and Rosenblatt 



( Il973bl ) as the standard tool, cannot be 



extended in a straightforward manner to the multivariate case. There are substantial differences 
between the multivariate and one- dimensional case, and for multivariate inverse problems the 
mathematical construction of confidence bands requires different and/or extended methodology. 
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In the present paper we will consider the problem of constructing confidence bands for the regres- 
sion function in an inverse regression model with a convolution-type operator with a multivariate 
predictor. The estimators and assumptions for our asymptotic theory are presented in Section |2l 
while Section |3] contains the main results of the paper. In Section H] we consider the special case 
of time dependent regression functions with a univariate predictor, which originally motivated 
our investigations. The argum ents of Section \5\ and O which contain all technical details of the 



proofs, are based on results by iPiterbard (119961 ). These authors provided a limit theorem for the 
supremum 

sup X{t) 



teT„ 

of a stationary Gaussian field {X{t) \ t G MJ^}, where {T„ C M'^jngN is an increasing system of 
sets such that X'^jTn) — )■ oo as n — oo. This result generalized the multivariate extension in 



Bickel and Rosenblatt! (Il973al ). who provided a limit theorem for the supremum sup^gjQ ^-jd X(t), 



as T ^ CO. 



2 Notation and assumptions 
2.1 Model and notations 

Suppose that (2n + l)*^ observations (xk, Ik), k = {ki, . . . ,kd) G Gn '■= {—n, . . . , n}'^ from the 
model 



(2.1) >k = S-la^k) +£^k := (/* V')(a;k) +£k, 

are available, where the function / : M'^ — )■ R is unknown, ^/^ : M'^ — )■ M is a known function and 
g := f denotes the convolution of / and ip, that is 

(2.2) g(x):={f*ij){x):= [ f{s)ij{x-s)ds. 

The basic assumptions that guarantee the existence of the integral (12. 2 p and also assure g G L^(]R'^) 
is that / G L^(M'^) and ip ^ /^^(M'^) H L'^{W^), which will be assumed throughout this paper. In 
model (12.11) the predictors Xk := k ■ ^ are equally spaced fixed design points on a (i-dimensional 
grid, with a sequence (a„)„gN satisfying 

nan oo and a„ \ for n — )■ oo. 

The noise terms {^k I k G G^} are a field of centered i.i.d. random variables with variance cr^ : = 
Ee^ > and existing fourth moments. As a consequence of the convolution theorem and the 
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formula for Fourier inversion we obtain the representation 



(2.3) 



fix) 



An estimator for the regression function / can now easily be obtained by replacing the unknown 
quantity J^g = J^{f * ip) by an estimator J^g. The random fluctuations in the estimator Tg cause 



instability of the ratio 



if at least one of the components of ^ is large. As a consequence, the 



problem at hand is ill-posed and requires regularization. We address this issue by excluding large 
values of S,j for any j = 1, . . . ,d from the domain of integration, i.e. we multiply the integrand 
in (12. 3p with a sequence of Fourier transforms Tri{h-) of smooth functions with compact support 
[—h~^,h~^Y. Here h = hn is a. regularization parameter which corresponds to a bandwidth in 
nonparametric curve estimation and satisfies — )■ if n — )■ oo. For the exact properties of the 
function rj we refer to Assumption A below. 

An estimator /„ for the function / in model (12. ip is now easily obtained as 



(2.4) 
where 



fn{x) 



exp(2^ x)Tri{h^)d^, 



mo 



(27r)2n'^a'^ 



n keG„ 



is the empirical analogue of Fourier transform of g. Note that with the definition of the kernel 

1 r J'viO 



(2.5) 



Kn{X) 



(27r)2 jRd J^ipif^ 
the estimator (12. 4p has the following representation 



exp{i^'^x)d^, 



(2.6) 



fn{x) 



{2'KYn' 



X X]ij 

h 



Note that the kernel can be expressed as a Fourier transform as follows 



The first step of the proof of our main result (see Theorem [T] in Section [3]) will consist of a 
uniform approximation of fn(x ) — 'Efn(x ) by a n ap propriate stationary Gaussian field. In the 



second step, we apply results of iPiterbargl (Il996[ ) and 



Bickel and Rosenblatt 



(Il973al ) to obtain the 
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desired uniform convergence for the approximation process of the first step. Finally, these results 
are used to construct uniform confidence regions for E/„(x). Our approach is then based on 
undersmoothing: the choice of sufficiently small bandwidths assures the same limiting behaviour 
of fn{x) — E/„(x) and /„,(x) — f{x). This avoids the estimation of higher order derivatives, which 
often turns out to be difficult in applications. 

Thus, the limit theorem obtained in the second step will also provide uniform confidence regions 
for the function / itself. Whereas undersmoothing implies that the rate-optimal bandwidth cannot 
be used, there has also been some theoretical justification why this cho ice of the regularization 



parameter is useful for constructing confidence intervals (see iHalll (1l992l )) 



2.2 Assumptions 

We now introduce the necessary assumptions which are required for the proofs of our main results 
in Section [3]. The first assumption refers to the type of (inverse) deconvolution problem describing 
the shape of the kernel function rj in the spectral domain. 

Assumption A. Let Ti] denote the Fourier transform of a function 77 such that 
Al. snpp{j^r]) C [-1,1]^. 

A2. J^T] G ^(M"') = {/ : ^ M I / G C°°(M"'), supp(/) C R'^ compact}. 

A3. There exists a constant D > 0, such that J^ri[C,) = 1 for all ^ G [—D,DY and \J^r]{^)\ < 1 
for all ^eR'^. 

Remark 1. 

1. The decay of the tails of the kernel Kn is given in terms of the smoothness of the integrand 
in (12.51) . The choice of a smooth regularizing function J^rj has the advantage that the 
smoothness of carries over to J^ri{h-) / J^ip. 

2. Functions like J^rj are ca lled burnp func tions. Their existence follows from the C°° Urysohn 



Lemma (see for example [FoUand ( 1984 ). Lemma 8.18 



3. Note that ^(M^) C ^(R''), where S^iW^) denotes the Schwartz space of smooth and rapidly 



decreasing functions. Since J-" : S^{R'^) — t- o$^(M°') is a bijection (see for example 
Jl984l ). Corollary 8.28) we know that r/ G yiR"^) as well. 



FoUand 



4. For the sake of transparency, we state the conditions and results with the same regularization 
parameter h for each direction. In practical applications this might not be the best strategy. 
The results presented in Section [3] and H] also hold for different sequences of bandwidths 
hi, . . . ,hd as long as the system of rectangles {[0, h^^]x, . . . , [0, /i^^] | n G N} is a blowing 
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up system of sets in the sense of Definition 14.1 in iPiterbarg (119961 ). This is the case if the 
assumption 




is satisfied for a constant Li that only depends on d and a constant L2 < 1. This condition 
is not a restriction in our setting because it holds whenever hj ■ rC^ — )■ Cj for constants 



In general, two kinds of convolution problems are distinguished in the literature, because the decay 
of the Fourier transform of the convolution function if) determines the degree of ill-posedness. In 
the case of an exponentially decreasing Fourier transform J^ip the problem is called severely ill- 
posed. In the present paper the class of moderately ill-posed problems is considered, where the 
Fourier transform of the convolution function decays at a polynomial rate (the precise condition 
will be specified in Assumption B below). Throughout this paper 



denotes the Sobolev space of order m G N, where 8^°"^ f is the weak derivative of / of order a. In 
the subsequent discussion we will also make use of the Sobolev space for general m > 0, which is 
defined by 



Assumption B. We assume the existence of a function ^E' : M — )■ M such that the kernel 
K = ■ Fr]) satisfies 

Bl. K ^ Q and there exist constants {3 > d/2, M G N, indices < /xi < /i2 < . . . < /iM and 
L^-functions /i, . . . , /m-i, /m : M'^ — )■ M with the property 



> 0, j = l,...,d. 



W™(M'^) = {/ G L2(R°') I 9^")/ G L2(M'*) exists V a G N"^, |a| < m}. 



W'"(M^) = {/ G L2(M'^) I (1 + len^-F/ G L^W")}. 



r/p e >V"^(M'^) (p = l,...,M-l) 



for all multi-indices a G {0, . 



, d}"^, \a\ < d and all m > 



^^^Y^, such that 



(2.7) 



5^/i^-^/p(x) + /i'^«^/„,m(x). 



p=i 



where /m may depend on ra, i.e. 



fM,n and ||/j\/,n||Li(Rd) = 0{1). 



B2. ■ Tt], ^' 



a 



■ Tf] G W"^{W^) for some m > 



d+\a\ 
2 
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B3. log(n) ■ /i^«(a„^/i-i) ■ = o(l) and hf^^{log{n)f = o(l). 

Remark 2. Assumption Bl implies h^Kn K in L'^(W^) and also specifies the order of this 
convergence. It can be understood as follows. If the convergence of the difference h^Kn — K is 
fast enough, i.e. 

(2.8) log{n)-h^''{anh)-l =o{l) 

we have M = 1. On the other hand, in some relevant situations (see Example [1] (ii) below) the 
rate of convergence h^^ is given by /i^ for each d and (12. 8p cannot hold for d > 4. Here, the 
expansion (12. 7p provides a structure, such that our main results remain correct although the rate 
of convergence is not very fast. We can decompose the difference h^Kn — K in two parts, where 
one part depends on n only through the factors h^'^ and the other part converges sufficiently fast 
(in some cases this term vanishes completely). 

Example 1. This example illustrates the construction of the functions in the representation (12. 7p . 

(i) Let d = 2 and ■ip{x) = | exp( — |xi|) exp(— |x2|), x = (xi,X2)'^, ^ = (^1,^2)^- Then we have 
= 271 {h^ + h\^l + Q + ^1^1), which implies /3 = 4, M = 3 and 

■ K^{x) = [ {h' + h\il + il) + ilH):Fr^{i) exp(^x^O 
K{x)= [ ^r/(0ei'e2exp(^x^0^e 
With the definitions /i(0 = 27r{^'f + il)Fr]{^), /2(0 = 27rJ^r/(0 and /„,3 = we obtain 



■ Kn{x) - K{x) = h' ■ Fh{0 + ■ ^f2{0- 



In this example, the condition \og{n)h? / \J a'^h'^ = o(l) is satisfied. However, the following 
results are valid if the weaker condition of a decomposition of the form (12. 7p holds. Further- 
more, since the factors of J^r] in /i and /2 are polynomials, we have fj{i) € rS^iW^), which 
implies ^"/^ G >V'"(M'^) for all a and all m e N. 

(ii) If |x| = a/x^ + . . . + and ijj^x) = 2~'^e~'^' we have 



2vr V 2 y (1 + lel 
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see 



FoUandl (119841 ). Exercise 13]. If d is odd we use the identity 



d+l 

d+1 2 /d+l 

2 

3 



E 

j=0 



'2i 



and an expansion of the form (12.71) is obvious from the definition of in fl2.5l) . If the 
dimension d is even the situation is more complicated. Consider for example the case c/ = 4, 
where 



mi) r(|)'^' r(|) 



(e? + + el + el) as n^oo. 



It follows that the constant /3 and the functions \E', Kn and K from Assumption B are given 
by /3 = d + 1 = 5, ^(0 = and 



d+l 



K(x) 



i2nyhdT{l) 



respectively. In order to show that Assumption Bl holds in this case we use Taylor's Theorem 
and obtain 



mv 



^(0 



for some constant G [0, 1). Recalling the definition of Kn in ( 12. 5 p this gives 



(h^Kn - K){x) = e 7h{i) + J'hAO 
where the functions /i and /2,n are defined by 

(27r)2r(|)2 2 

respectively. It can be shown by a straightforward calculation that ^"fj E W^"^'"' (M'^) for 
all a e {0,...,4'^. 
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Remark 3. In the one-dimensional regression model (I2.ip . iBirke et al.l (120 10[ ) assume that the 
kernel K has exponentially decreasing tails in order to obtain asymptotic confidence bands, which, 
in combination with the other assumptions only allows for kernels that are Fourier transforms of 
C°°-functions with square integrable derivatives. Our Assumption B is already satisfied if K is the 
Fourier transform of a once weakly differentiable function with square integrable weak derivative. 



i are included if d 



such that all indices of ill-posedness /3 that satisfy /3 > 
assumptions regarding the bandwidths are less restrictive compared to 



1. Moreover, the 



Birke et al. 



mm . 



Our final assumptions refer to the smoothness of the function / and to the decay of the convolution 
f 

Assumption C. We assume that 



CI. There exist constants 7>2, m>7 + | such that / G 
C2. There exists a constant > such that 

i(/*^)(2)i'(i+ i^n^d^ < oo. 



3 Asymptotic confidence regions 

In this section we construct asymptotic confidence regions for the function / on the unit cube 
[0, 1]^. These resuhs can easily be generalized to arbitrary rectangles X^^]^[aj, hj] for fixed constants 
"^^j {j = ^1 ■ ■ ■ id) and the details are omitted for the sake of brevity. We investigate the limiting 
distribution of the supremum of the process {Yn{x) \ x E [0, l]'^}, where 



(3.1) i;w . '^-';^;,v^ |/„M-E/,.M 



and the kernel Kn is defined in (12. 5p . Note that 



sup \Yn{x)\ = sup \Yn{x) 



where the process 



(3.2) r„(x) := E i^n(x-Xk[).k 
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can be approximated by a stationary Gaussian field uniformly with respect to [0,/i^^]'^. Thus 
the desired limiting distribution corresponds to the limiting distribution of the supremum of a 
stationary Gaussian process over a system of increasing smooth sets with sufficient similarity of 
their speed of increase, and is therefore of Gumbel-type. The precise result is given in the following 
Theorem. 

Theorem 1. Assume that for some fixed constant 5 E {0,1], 5 < d and a constant r > the r-th 
moment of the errors exists, i.e. El^kT < If additionally Assumptions A and B are satisfied 
and ^^"'ild = then we have 



lim P I sup ( \Ynix) \ - Cn,3 ] ■ Cn,3 < K ] = e 
, a:e[0,l]' 



where 



i2n 



,2d 



mi 



Ci = det 

Cn,2 = 

C„,3= \/21n(C„,2) + 



l"^ {v)J^ri{v)\'^ViVj dv 



hi = 1, 



Ci 1 
(27r)°'+i ¥ 



(rf-l)ln(21n(C„,2)) 



The proof of this result is long and complicated and therefore deferred to Section |5] and |6l In 
the following we apply Theorem [1] to construct uniform confidence regions for the function / by 
choosing the bandwidth such that the bias decays to zero sufficiently fast. More precisely, if the 
condition 



log(n) sup f{x) - Efn{x] 
xe[o,i]'* 



is satisfied, it follows directly that the random quantities sup^gjQ ]^]d and 



sup 



\K\\L2{R'i)^ xe[o,i]d 



f{x) - fn{x) 



have the same limiting behavior. 



Corollary 1. Assume that the conditions of TheoremUi Assumption C and the condition 

1 



n] 



o(l) for n — 7- oo 
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are satisfied. Then we have for any /t G M 
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lim P (Ux) - < f{x) < Ux) + for all x G [0, 1]'') = e 
where the sequence is defined by 



;^ + a,3Vi|i^lL^ 



As a consequence of Corollary [T] an asymptotic uniform confidence region for the function / with 
confidence level 1 — a is given by 

(3.3) {[fn{x) - $n,-ln(-0.51n(l-Q)), fn{x) + $n - ln(-0.5 In(l-a))] \ x e[0, if}. 

The corresponding (1 — a)-band has a width of 2$„__in(_o.5in(i-a))- Here, the factor ^ is due to 
the ill-posedness of the inverse problem (see Assumption B). It does not appear in corresponding 

_d 

results for the direct regression case. On the other hand the factor an ^ arises from the design 
on the growing system of sets {[—a^^,a~^f\n G N, }. In the case of a regression on a fixed 
interval it does not appear as well. The width of the asyn iptotic point-wise c o nfiden ce intervals 



in the multivariate indirect regression case as obtained in iBissantz and Birkd (120091 ) is of order 



/ , where is the total number of observations. Their point- wise confidence intervals are 

hl^y/Nh'^ai 

smaller than the uniform ones obtained in Corollary [TJ The price for uniformity is an additional 
factor of logarithmic order, which is typical for results of this kind. 

In applications the standard deviation is unknown but can be estimated easily from the data, 
because this does not require the estimation of the function /. In particular, (13. 3 p remains 
an asymptotic (1 — a)-confidence band, if a is replaced by an estimator satisfying a — a = 
Op (l/log(n)). 



4 Time dependent regression functions 

In this section we extend model (12. ip to include a time dependent regression function, that is 

(4.1) Y,- k,„ = (T^/t^) (aJk) +£k, k G G^, j = -m, . . . , m, 

where x^ = ^ and tj = m = m{n), such that m(n) — )• oo and 6rn(n) \ as n — )■ oo. 
We assume that ip does not depend on the time and the operator is defined by 

(T^ft) = [ ftiym--y)dy. 
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This assumption is rea sonable in the contex t of imaging where the function ijj corresponds to the 



point spread function (IBertero et al.l ( l2009l )). If it is not satisfied, i.e. the convolution operator 
effects all coordinates, the problem can be modeled as in Section [2l 

For a precise statement of the results we will add an index to the Fourier operator J-' which gives 
the dimension of the space under consideration. We will write J^d+i if the Fourier transform is 
taken over the whole space Mf^^^ and J^a to denote Fourier transformation with respect to the 
spatial dimensions. By the same considerations as given in Section |2] we obtain an estimator / for 
the function ft 

fnix; t) = —^-iTT [ "^t.^ J^dViCh, rht) exp{itT + ix^O d{C, t) 
(27r)— V+i (27r)2j^d^(0 



where G'^^^^^ denotes the grid {—n, . . . , n}'^ x {— m, . . . , m} and the kernel Kn is given by 



exp (zrt + i^^x) 
(27r)^ Jr^+i J^di^iji) 



(4.2) K^{x; t) = -^—^ / '—-^^ '-J'd+iVi^, r) d{^, r). 



Here the function fj : R"^"*"^ — )• M satisfies condition A and ht = ht{n) is an additional sequence 
of bandwidths referring to the time domain. For the asymptotic analysis we require a modified 
version of Assumption B. 

Assumption B Let Assumptions Bl (with corresponding kernel K) and B2 hold and additionally 

assume that 

— - d - 1 

-B3. log(?2 + m{n)) ■ h^'^'{an ^^ 26^^^^771(72)2) = o(l) and for p = 1, . . . , M — 1 
/i^'f (log(n + 777))^ = 0(1). 

Theorem 2. Define 



|L2(IRd+i)| 



(r\\K 



and let the moment condition of TheoremUl and Assumptions A and B he satisfied. We further 
assume that the bandwidths ht and h, and the sequences (a„)„gN and (&m(n))neN satisfy 



nan 1 /'mbm\i 1 



log(n + m) ( . / — ; = + ( ) , , - = 0(1) for n ^ 00 

mbm ^n'htaih'i \ na,, J ^^^^ } ^' ^ 
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ht + h<Li- h'^^^-^'^h^^-^'^ 



for some constants Li < oo and L2 G (0, 1). Then we have for each k G M, 



lim P sup \Yn{x; t) \ - Dn,3 ■ Dn,3 <k \ =e 

\:re[0,l]'* 



where 



Di = det 



{2n) 



n 



n,2 



and 



. . . ,Vd)J^d+iv{v)\'^ViVjdv 



i,j = l,...,d+l 



(27r)'^+2 h'^ht 



D„,3 = A/21n(D„,2) + 



(rf-l)ln(21n(D„,2)) 



2v/21n(D„,2) 

Corollary 2. // the assumptions of Theorem\^ are satisfied, the limit kernel K is defined by 

1 



(4.3) 



K{x,t) 



27r) 2 



■^{0^d+ifl{i, r) eM^e X + iTt) r). 



anc? t/ie function /(.)(•) : M'^^^ — )■ satisfies Assumption C, then it follows that 

lim P t) - < /(x; t) < U{x; t) + /or a// (x, t) G [0, Ij'^+i) = e-2^"^ 



where the constant ^n,K is defined by 



+ Dn,3)cr\\K\\L2(M'i+^ 



hP^h<^n'^aimhraht{2TiY+^ ' 
Asymptotic confidence bands for the function ft{x) at level 1 — a are hence given by 



{[fn{x\t) - $„_ln(-0.51n(l-a)),/n(a;;t) + $n,- ln(-0.5 In(l-a))] | {x,t) G [0,1]''+^} 
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5 Proofs of Theorem [T] and Corollary [T] 
5.1 Notation, preliminaries and remarks 

First, we introduce some notation which is used extensively in the following proofs. Define for 
a = (ai, . . . , Orf), 6 = {bi,...,bd) E M.'^ the (i-dimensional cube [a,b] := X'j^-^[aj,bj]. Let k = 
{ki,...,kd) e Z'^, a = (ai, . . . , a^) G {0, l}'^ be multi-indices, := (0, . . . , 0)^ G R'^ and 1 := 
(1, . . . , 1)"^ G R'^ and define Gk := H [-k, k]. For j e {1, . . . ,d} we denote by the canonical 
projection of onto Z-' , i.e. is a j-dimensional grid of integers with possibly different length 
in each direction. For j G N let G^"^ := G^ fl W denote the part of the grid G^ whose vectors 
contain only positive components and write Gj^ for G^'^. We further introduce the bijective map 



that maps each a to the set f C {1, . . . ,d} that contains the positions of its ones. For a G {0, l}'^ 
and {vi, . . . ,v\a\} = Ed{a) let {x)a '■= (xt,^, Xt,2, . . . , a:„|^|) denote the projection of x G M'^ onto 
the space spanned by the coordinate axes given by the positions of ones of the multi-index a. 
For a,b eR'^ let (a)„ : (6)i_„ = (a : 6)^ := (a^^ ■ . ..,af- b]''^") denote the vector of the 

components of a and b specified by the index a. The following example illustrates these notations. 

Example 2. For = 2 we have {0,1}^ = {(1, 1), (1, 0), (0, 1), (0, 0)} and the mapping E2 is 
defined by 



Harlow. 




^ Vi{l,...,d}) 

^ V = {vi,...,v\a\}; a^,^. = 1, j = l,...,|a| =EJ 



i=l 



S2((l,l)) ={1,2}, E2((l,0)) = {1}, E,{{0,1 



)) = {2} and E2((O,O))=0. 



For any x = [xi, X2) G 



we have 



(a;)(i,i) = X, (a;)(i,o) = xi and (x)(o,i) = X2. 
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For a = (ai, 02), b = (61, 62) ^ we have 



(a : = (01,02) = a, (a : 6)(i,o) = (ai,&2), (a : &)(o,i) = (^1,02), (a : 6)(o,o) = (&i,&2) = b. 

For the approximation of the integrals by Riemann sums we define for muhi- indices a, a G 

{o,in{o} 

(5.1) AM;a,b):= Yl = E 

Qe{0,l}'*,Q<a ae{0,l}'',a<Q 

where the symbol a < a means aj < for j = 1, . . . , rf. Note that for a = 1 G M"' we obtain the 
special case of the d-fold alternating sum, i.e. 

A(/;a,6):=Ai(/;a,6)= (-!)'"'/((«:&)«)= Yl (-!)'"'"'/((«: &)i-«), 

ae{0,l}<* ae{0,l}'' 

Note that Aa{f;a,b) can be regarded as the increment of the function /q,((x)q,) := /((x : b)a) 
over the interval [{a)a, (&)a] which also gives rise to the alternative notation 



(5.2) 



Aa if; a,b) = A {fa, {a)a, {b)a) ■ 



5.2 Proof of Theorem [T] 

To prove the assertion of Theorem [1] we decompose the index set Gn = {—n, . . . ,n}'^ of the sum 
in (13. ip into 2*^ + 1 parts: the respective intersections with the 2'^ orthants of the origin in M"^ 
and the marginal intersections with the coordinate axes. Our first auxiliary result shows that the 
contribution of the term representing the marginals is negligible (here and throughout the paper 
we use the convention 0° = 1). 

Lemma 1. 



sup 

a;e[0,/i-i]'' 



J2 Kn(x-^X^y^ 
I6{0,l}d\{l} (k:0)c,keG+ 



Op 



log(n) 



We obtain from its proof in Section Elthat Lemma[T]holds under the weaker condition = oil), 

■y TiCLji (1 

which follows from the assumptions of Theorem [H Next we consider the "positive" orthant 
and show in three steps that 



(5.3) 



sup 

x&[0,h-^ 
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where the processes and are defined by 



(5.4) 
(5.5) 



keGS 



(27r)^ 



L2 



/" is:(x-u)rf5(M), 



respectively, i? is a standard Brownian sheet on (see the proof of Lemma [2] for details) and K 
de notes the k ernel defined in Assumption B. The final result is then derived using Theorem 14.1 



m 



Piterbard (119961 ). To be precise note that it can easily be shown that 



lim n'^a'^hV ■ Var (/„(a;)) = -f--. I \K(^ -u)\^du-'' " "^^ 



(27r) 



h 



2d 



(in particular the limit is independent of the variable x, which is typical for kernel estimates in 
homoscedastic regression models with equidistant design). We further obtain for the function 
r{t) = {27rf'^\\K\\l^ J^, K{v + t)K{v)dv that 



(27T 



,2(1 



I /TIP 

I-"- IIl2 



K{v + t)K{v) dv 



, (27r)2'^||ir||2 
dt < ^ ' < cx), 

ll-'^ IIl2 



Therefore the conditions of Theorem 14.1 in 
Theorem 1 follows. 



Piterbargj (119961 ) are satisfied and the assertion of 



The remaining proof of the uniform approximation (15. 3p will be accomplished showing the following 
auxiliary results. For this purpose we introduce the process 



„ E (-1)'°' E A.(A-.or../,)B(j:(„H_J 



u+l 



where the function Tx is defined hy Tx{u) := x — 
(5.6) /j := [(j - 1) : (n)i_,, j : (n)i_J C 



and we use the notation ( 15. 2p . 

Lemma 2. There exists a Brownian sheet B on such that 



sup |rW(x)-Fi+)(x)|=o 

a:G[0,/i-l]'* ^iy/l0g(n) 



a.s. 



We obtain from the proof in Section 16.11 that Lemma [2] holds under the condition 



log(") 

s i d 



0(1), 
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which follows from the assumptions of Theorem [H The next step consists of the replacement of 
the kernel Kn in the process Yn^i by its limit. 

Lemma 3. 



sup 

where the process F„^2 is given by 



Op 



\og{n)J ' 



As described in Section [5Jl for fixed a G {0,1}'^, j G gIT''"'' the quantity (i^ o Xj;; /j) can be 
regarded as the increment of the function {Kn o T,j.)a{{u)a) = Kn o r^iiu : n)a) on the cube 
[(j — l),j]. This point of view is the basic step in the approximation by the Riemann-Stieltjes 
Integral of B{{{-) : n)i_Q,) with respect to the function {Kn o Tx)a for each a G {0, l}*^. 

Lemma 4. 



xe[o 



where the process Y^^^^ is defined by 



(5.7) rij(x) ^ / K{x - u) dB{u). 

We obtain from its proof in Section [6.21 that Lemma H] holds under the condition ^^^^^ = o(l), 
which follows from the assumptions of Theorem [H In the final step we show that the difference 

y'^^\^) - YiCAx) = / V,\[o,K/.)-i]4^) K{x - u) dB{u) 

jRd 

is asymptotically negligible. 

Lemma 5. sup^g^.h-i]'* l^nM - Y{x)\ = op((log(ra)-i). 

5.3 Proof of Corollary [1] 

The assertion follows from the estimate 

(5.8) sup f{x)-Efn{x) =o{h-^{h^n'^ai)-^/^) . 



sup |yW(x)-FiJ(x)|=opf— ^ 



n) 



(2vr) 



d 
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To prove (15.81) we use the representation (12.61) and obtain by a straightforward calculation 

n 



' ' " keG n 



an an J 



(27r 

where the term 



denotes the "error" in the integral approximation and 

1 



V an ^ an 



(f^^)(z)Kj{x-z)l-) dz. 



An application of the Plancherel identity (see for example iFoUandl ( 1l984j ). Theorem 8.29) gives 
(observing Assumption Al and A3) 

E/n(a;) = -4r- f J'f{h-'^)J'i^{h-'^)^^exp (th-'x^^) d^ + i?„,i(x) + Rn,2{x) 

(27r) 2 JlRd 



f{x) + -R„,i(x) + -R„,2(x) + Rn,^{x) + -R„,4(a;) 



where 



RnA^) = ——d [ -^/(Oexp(zx^)rf^ 
(27r)2 

^",4(3;) = - — -J / J^fiO ■ J^vi^h) exp(zxO c^^- 

We further obtain from Assumption C 



and finally |-Rri,3(x)| < X]j=i /{5 >0} 1-^/(01 '^^ = o{h"'). With the same arguments it follows 
i?^4(x) = o(/iT), since |J^r?(^/i)| < 1 for all ^ e M'^. Define A = ([-^,^]'^)^, then we obtain 
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from the representation fl2.7p the estimate 



|i?n,2(x)| < 



\{f*ij){z)\'dz 



An 



1\ ,2 ' ^ 2 



\K{ {x-z)-)\'dz 



+ (y^ \{h^K^-K)(^{x-z)-)\'dz 



{2'KYhP 



An 



\{f*i^){z)\^dzy(0[h''al)+0[h^^^'al)) = 0[-j^ 



uniformly with respect to a; G [0,1]'^. Note that by Assumpt i on C we have / G W'-'"-! (M'^) 
and since m > 2 + | Sobolev's Embedding Theorem JPoUandl (119841 ). Theorem 8.54) implies 
the existence of a function / G C^(]R'^) with / = / almost everywhere. Observing that the 
convolution function ip is inte grable gives ( f * ip) = (9"/) * ip E C(]R^) for all a G {0, 1,2} 
with |a| < 2 (see for example iFoUandl (119841 ). Proposition 8.10), which justifies the application 
of Taylor's Theorem. Straightforward but tedious calculations give for the remaining term ( 15.91) 
Rn,ii^) = 0(^3^+^) + ^(^) uniformly with respect to x G [0, 1]^. 



5.4 Proofs of Theorem [2] and Corollary 



First we will show that the kernel K„ satisfies conditions Bl and B2, with the kernel K defined 



(14. 3p . If Assumption B holds we have 



~^iO)J'd+ifli^,r)expitx'Od^ 



M-l „ „ 

V/i^'' / ^p{OJ'd+iV{^,T)exp{tx''Od^ + h^" / ^M,n{OJ'd+iV{^,T)exp{tx''Od^, 
„=i -^^"^ -^^"^ 



which implies 



A/-1 



hf'K^ix, t) - K{x, t) = y2 h''" [ ^piOJ'd+M, t) exp(ix^e + itr) d{C, r) 

p=i •^18''+^ 

+ h>'^' [ <ilMAOJ^d+iv{^,r)exp{ix^^ + itT)d{^,T). 



A careful inspection of the proofs of Theorem [T] and Corollary 1 shows that the arguments can 
be transferred to the time-dependent case if the increase of n and m{n) as well as the decrease 
of an,bm{n), h and ht are balanced as given in the assumptions of the theorem. The details are 
omitted for the sake of brevity. 



22 



6 Proof of auxiliary results 



6.1 Proof Lemma [2] 



Define S'k := ^j6G+ ^j' 5j = if min{ji, . . . = and recall tlie definition of Yn~^^ and i 



m 



( 15 ■4p and before Lemma [21 respectively. In a first step we will replace the errors Ek by increments 
given in terms of partial sums S^-a for a G {0, l}*^. To be precise, we use the representation 



ae{0,l}'* 

A straightforward calculation gives 
hf" 

kec: 



ae{0,l}'* 



n \ 



a\\K 


\2^n<^h'^ai 






a\\K\ 









J2 /^nor.(k-l) 5^ i-lpS^. 



5^ (-1)1"! 5^ ir„Or,,(k-l)5((k-l);k)a 

te{o,i}'' 



( 5Z (-1)'"' $^(^nOr,.(k-l)-ir„or,(((k-l):ky)5((k-i):k)a 



ae{0,l}'' 



a\\K\\2^/n'^h'^a^ 

+ E (-1)'"' 5^ ^nOr,(((k-l):k),)^((k-l):k)a). 



ae{0,l}'' 



keGj 



Now we can make use of Proposition 6 and Proposition 3 of lOweru (120051 ) to rewrite the sums, 
such that the increments given in terms of partial sums can be expressed by increments given in 
terms of the kernel Kn- We obtain 



a\\K\\2^/n^> 

+ E (-1)'"' E E (-1)'^' A/.(^n ° k - 1, ((k - 1) : k) J5((k_i).k). 



ie{o,i}'' 



keG+ /3e{o,i}'*\{o} 



The quantity A^(A'„ora,; k— 1, ((k — 1) : k)^) can only take values different from zero if a < 1 — /3. 
Note that for a < 1 — /3 the equality (k)^ = ((k — 1) : k)^)^ holds which implies that in this case 
we also have [(k — l) , (((k — 1) : k)^) ] = [(k — 1)^, (k)^]. We further obtain 



a\\K\\2^Jn'^h'^t 



K^orMSin)+ E (-1)'"E E (-1)'" 

I3£{0,iy\{0} keG+ a6{0,l}'*-l'3| 



X 



Ap{Kn o r^; k - 1 , (k)^ : ((k - l)i_^ : (k)i_^)5)%)^:((k-i)i_^:(k)i. 



■I3)& 
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The alternating sum with respect to the index a can b e written as an increment A as defined in 
flS.ip which then defines a telescope sum according to lOwenI (120051 ). Proposition 2. Taking into 
account that 5'(k) = if fcj = for at least one j G {1, . . . , c?} gives 



X 



With the definitions X{A) := YlkeAcZ'^-^^ subset A G Z'^, we can rewrite these partial 

sums as set-indexed partial sums with index class n ■ where := {(0, 7] | < 7j < 1, 1 < j < 
d} and n ■ := {n ■ S \ S & S^}. It follows directly that is a sufficiently smooth VC-class of 
sets, which justifies the application of Theorem 1 in iRid (Il993[ ). Therefore there exists a version 
of a Brownian sheet on [0, ooY, say such that 



(6.1) 



sup 
keG+ 



Sv 



a 



5i(k) 



O ( {\og{n)Y^n'^'^^ ) a.s. 



Recalling the definition of Jj in f l5.6p we further obtain 



J2 A/3 {Kn O /j) ■ " (j : (n)i_;3) 



The estimate ( 16. ip implies the existence of a constant C G M+ such that 



n' 



L^e{o,i}d, 1^1=1 "^[O'K'^) 



+ V / (a„/i)-il)) ) (rfw)^ 



+ |ir„(x-(a,/i)-4)| 



a.s. 



It follows from Assumption B that the function u t— )■ {u)^^ d°'K{u) is integrable on for all 
a G {0, 1}'' such that 



(m)^2 |9^ir„(x-M)|t;M = 0(/i— -^) 



[0,(a„/i)- 
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and 



[0,(a„/i)-i]l/3| 



d^Kn ((x - {u : (a„/i)-il))^) | {du)p + \K^{x - {a^h)-^l)\ = 0{{anh)ih-P). 



Note that for sufficiently large n such that a„ < | we obtain ^ — (a„/i)~^ = 

uniformly with respect to j (note that Xj G [0, Z?-^^]). Let be a continuous version of Bi. We set 
B{t) = if < for at least one index j E {1, . . . ,d} and let {Ba \ a E {0, 1}^} be 2'^ mutually 
independent copies of B. For t G M'^ define 

then the process {B{t) := Eaelo.ii-^ ^"(^) I ^ e is a Wiener field on M^. 



6.2 Proof of Lemma [4] 

Note that d°'K exists and is integrable for each a E {0, 1}'^. Consequently, the kernel K is o f 
bounded variation on [0, {anh)~^Y the sense of Hardy Krause for each fixed n (see lOwenI (120051 ). 
Definition 2). Therefore an application of integration by parts for the Wiener integral (note that 
the kernel K has not necessarily a compact support) and rescaling of the Brownian sheet Y^^^ 
yields 



a6{0,l}<*\{0} ^[0,(a„h)-i]l-l 

+ A(K(x--)-i?(-)JO,(a„/i)-Y) 

V (-1)1"! / B{{u: (a„,/i)-il) J ff'K [x - {u : {a^h)-^l) ) {du\ 



ae{0,l}<*\{0} 



+ A(i^(x--)-5(-),[0,(a„/i)-i]''). 



Recalling the definition of Yj^^ix) and identity (15) in lOwed (|2005| ) we can replace the increments 
by the corresponding integrals, that is 



E (-1)'"' E / 



„iq|.+ " [{nanh) i(k-l)a,(na„/i.) ^(k)^ 



d''K{x-{u:M-H)J {d 



u) 



«e{o,i}'^\{o} 

X B (((m„/i)-ik : (a„/i)-4) J + A {K{x - ■) ■ 5(-), [0, (a^/i)-^) 
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where the remainder Rn st( x) is defined in an o 



for the Brownian Sheet (see 



wious manner. From the modulus of continuity 
KhoshnevisanI (j2002l ). Theorem 3.2.1) it follows that for a, 6 G M"^ 



(6.2) 



which yields 



limsup sup '^^ "^ < 24 ■ d\\b\\ 

5^0+ s,te[a,b],\\s-t\\^<5 ,/(51og(i) 



d/2 

OO 5 



Kyix) - V;^? (^)l = \Rn,si{^)\ < sup sup \B{s) - B{t)\ 

s,te[0,2]'^:\\s-t\\^<5 



log(n) 



n 



J [0,(a-n/i)-l]d 



{iuy)^\d^K{x-u)\du + 0{h-^) 



(note that the dominating term in Rn,si{x) is given by the summand where |a| = d). With the 
same arguments as in the proof of Lemma [2] we finally obtain 



Ml 



ln(na„/i) 



where we used the estimate (16. 2p for the modulus of continuity of the Brownian sheet (note that 
this estimate is independent of x). 



6.3 Proof of Lemma [5] 

Integration by parts gives 

(6.3) A„,3:= \YiCX^)-y^^\^)\ 

B{u)d^K{x-u) du 



< 



+ 



[o.~)A[o,^]'' 



(-1)1-1 / ^ ^B{{u: {a^h)-H)^) d-K [x - [u : {a^hyH) J {du) 



oe{o,i}'*\{o,i} 



+ I A {K{x - ■)B{-)- [0, (a„/.)-Y) I := lA^WI + |AS(^)I + 1^5(^)1, 

where the processes /s!"^\{x), j = 1,2,3 are defined in an obvious manner. Let n be sufficiently 
large such that ^ > 1 and a„ < |. Since B{u) = if tj = for at least one index j G {1, . . . ,d} 



26 



we have 



\Ai:iix)\ = \K {x - ia^h)-H) ■ B {{a^h)-'l)\ 

^2d(a„/i)-"ln(ciln((a„/i)-i)) 



An ap plication of the version of a law of the iterated logarithm given in Theorem 3 of lParanjape and Park 
( I1973I ) yields the estimate 



sup \A^^l{x)\=0{l)- J2d{anh)~''\n{d\n{{anh)-^)) sup \K {x - {anh)'^l)\ 

xe[o,/i-i] ' xG[o,h-i] 



< 0(1) ■ A/2rf(a„/;.)~'^ln(rfln((a„/i)-i)) sup \K {v)\ = o ' ^ 



— anh. 



log(n) 



a.s. 



uniformly with respect to x. 

To show that A^^^^{x) and A^^3(x) are asymptotically negligible we also apply the LIL for the 
Brownian sheet. For each summand, say A^^g^, in A^^3(x) {\a\ < d) we have 



AgLW := / B {{u : (a„/.)-4) J d'^K [x - [u : {a^hyH) ^) (du) 

= (a„/i)-l"l / B{{u: 1) Ja„/i)-i) d'^K [x - {u : l) Ja„/i)-^) {d 



Scaling of the Brownian sheet yields 



O ((a„/i)-^) 



/ B{{u: 1) J d^K {x-{u: l) Ja„/i)-i) (du) 
(9"K {x-{u: l)janh)-^) (du) 



With the same arguments as in the proof of Lemma [2] we conclude that the leading contributions 
are given by the quantities A^^g ^(x), where \a\ = d — 1. For a = (0, 1, . . . , 1) obtain 

sup \A^^l^^{x)\ = Op Uanhr^) sup / \d"K{v,U2, . . . ,Ud)\ d{u2, . . . ,Ud). 

x&[0,h-'^]'i ' ' ^ ' t,<__i jRd-l 

^ — 2anh 

This gives sup^.g[o,/i-i]d I A^fs (0 1 i)(^)| = Q( iog(n) )- Applying the same argument to the other terms 
yields A^^3(a;) = Op( iog(„-) ) uniformly with respect to a; G [0,1/h]'^. Finally, a similar argument 
gives for the remaining term in (IG.SI) A^^\{x) = op ( jpg^^-) ) ; which completes the proof of Lemma [51 
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6.4 Proof of Lemma [3] 

Note that we have 



The representation fl2.7p and the definition fl5.6p yield 



1 <^ Let^i}^ 



+ Op 



j6G, 



log(n) 



For each fixed p we can now perform the approximation steps of the previous Lemmas and obtain 



log(n) sup 

xe[o,h-i]'* 



-r^, E (-1)'"' E A.(^/,or.;/j)5(j:(n)i_ 



/ J-'/p(x — m) c/i?(M) = Op(l). 



It can easily be shown that for all p = 1, . . . , M — 1 

hm n'^aih'Y^ii^^^ E ^^^((^ " ^k)-^ 
n-s>oo \n'^atn°- ^-^ \ h 



a 



2|| ^ ||2 
pll2? 



keGn 



where the limit does not depend on x. We finally obtain, repeating the approximation steps given 
in the previous Lemmas for each of the 2'^ — 1 remaining orthants 



log(n) sup 



E (-1)'"' E AJJ-/,or..;(-l)^/j)fi((-in:(n)i_„) 



/ Tfp{x-u)dB{u)\=Opil). 



Note that 



r{x — z):=E,( T fp{x — u) dB{u) I T fp{z — u) dB{u)\ = I fp{x — z + u)fp{ 



u) du 
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and ||r||i < ||/p|p < oo. The system of sets i \0,h ^Y\n G N} is a blowing up system of sets in 



the sense of definition 14.1 in 



Piterbard ( 1l996l ). If we define 



Zp{x) 



J^fp{x — u) dB{u) 



then Theorem 1 in iBickel and RosenblattI (jl973al ) gives the asymptotic independence of the scaled 
minimum and maximum of the process Zp, which, with th e observation tha t Zp and —Zp have 
the same distribution and an application of Theorem 14.1 in iPiterbargI ( 1l996l ) yields that for G ~ 
Gumbel(ln(2),l) 



sup [ [ \Zp{x) \ - C„,3 )C„,3 ] ^ G for -)■ oo, 

a;e[0,/i-i]'* 



where the constants Ci, Cn,2 and C^^s are given by 



Gi = det 



\fp{v)\^ViVj dv 



hi = 1, 



n,2 



Ci 1 
(27r)'^+i ¥ 



a,3= V2MCn,2) + 



(rf-l)ln(21n(C'„,2)) 



2J21n(C„,2) 



Since h'^'' = o ^j^j we obtain /i^p sup^g[o,/i-i] I^p(^)I = op((logn) ^^^) for each p = 1, . . . , M — 1, 
which justifies the replacement of h^Kn by K. Since the outer sum does not depend on n this 
gives the desired result. 



6.5 Proof of Lemma [T] 

With the same arguments as in the proof of the previous Lemmas we can replace the errors by 
combinations of partial sums and perform the same approximation steps. In each replacement we 
obtain at most ad — 1-fold sum which yields the desired result right away. 



29 



